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Comparisons are carried out of the confidence intervals constructed with Neyman's frequentist method and with 
the AL = 1/2 likelihood method, using the example of low-statistics life time estimates. 



1. P.d.f. for life time estimators 

For a given value r of the true life time, the P.D.F. 
of a measurement is 



In our case 



dW 1 



t 



and so for an experiment with n measurements 
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The negative log likelihood function is 
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The maximum likelihood estimator of the lifetime can 
easily be found minimizing L 
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so the probability Q can be transformed to 
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Given some true value r then for any algorithm that 
defines a confidence interval t^^^{_) we can evaluate 
the coverage P: 

-i;r^'7-/(T)"""-(-?)-' 

where ti + At'^+^ = t; T2 — Ar*^"^ = t. 

2. Liltelihood Function confidence 
interval 

The conventional Likelihood function method for 
finding a 68% confidence interval 0, 0] is to find the 
values of t for which 

AL = L-Ln = -. 
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For example, for n = 5 the limits are 

[ti,T2] = [0.6595f, 1.6212f] . 
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The coverage of this interval, from Equation (jSJ, is 

0.6747, 
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where the integration limits, corresponding to are 

[Ti,f2] = [0.6168r, 1.5163r]. 

The coverage is close to, but significally different from, 
the nominal value of 0.6827. 

Examples of confidence intervals obtained by this 
means are shown in Tabled as the values in paranthe- 
ses. The 95% confidence interval was obtained using 
the rule AL = 2, and 90% upper limit using a one 
side interval for which 

AL = [crf^^ (2 • 0.9 - 1)]^ « 0.821. 

The coverage given by such intervals is shown in Fig.^ 
evaluated using a Monte Carlo method. 



3. Bayesian confidence interval 

For comparison we can estimate a Bayesian confi- 
dence interval for the same example of n = 5. In the 
Bayesian approach ^ |^, the likelihood function 
is considered to be a probability density for the true 
parameter t. Assuming a flat prior distribution for r 
this is 

dW 1 ( nf\ 

— — = P(t) ^ C = — • exp . 
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After normalization (for n > 2) this becomes: 
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Figure 1: Coverage for likelihood function confidence 
intervals, evaluated by Monte Carlo. Statistical errors are 
shown when they exceed the size of polymarker. ▲ — 
95% Conf.Interv., ■ — 90% Upper limit, • — 68% 
Conf.Interv. 




Figure 2: Probability density function for the true value 
of the parameter r in a Bayesian approach (Equation (|5J 
with n = 5 and f = 1). The shaded regions are the 16% 
"tails" . 



which for n = 5 gives 



1 
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The 68% central confidence region for this distribu- 
tion is (see Fig.EJ: 

The coverage of this region is actually not 68.27% but 
64.31%. 



4. Neyman's confidence interval 

Neyman 0, IE proposed a frequentist construc- 
tion of a confidence zone (or confidence belt) as follows 



Figure 3: Illustration of the construction of a confidence 
zone (or confidence belt). 



(see Figure OJ: 

1. One obtains functions ti{t) and T2(t) of the true 
parameter r such that 

fi(T) 

r dW(f:T) ,^ _ 1-/3. 


J df — 2 ' 

f2(r) 

where /3 is the confidence level required, here 
/? = 0.6827. For n = 5 these are simply fi(r) = 
0.568r, T2{t) — 1.433t, as shown in Figure 

2. One defines the inverse functions 

which, for a given value of f, define the borders 
of the confidence interval for r, with coverage p. 

In our example, there are Ti(f) — 0.698f, 
T2{t) = 1.760f. 

Thus the result of a lifetime experiment of this 
type can be written 



r - r ■ (1+0•760^ 



The coverage evaluated is 0.6826 — the differ- 
ence of 0.0001 is purely due to rounding errors. 

Table 13 shows these intervals for several values of n, 
with the likelihood approximation shown in paranthe- 
ses for comparison. 

TablelnlcomDares the coverage of all three methods 
for the n = 5 case. 
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Table I Lifetime confidence intervals obtained by Neyman's method for various values of n, the number of 
measurements, and confidence levels. 
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0.302 (0.341) 


0.760 


(0.621) 


0.519 


(0.541) 


2.159 


(1.858) 




6 


0.284 (0.318) 


0.657 


(0.550) 


0.492 


(0.513) 


1.786 


(1.571) 




7 


0.270 (0.299) 


0.584 


(0.497) 


0.470 


(0.489) 


1.538 


(1.374) 




8 


0.257 (0.284) 


0.529 


(0.456) 


0.452 


(0.469) 


1.359 


(1.228) 
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0.247 (0.271) 


0.486 


(0.423) 


0.435 
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1.225 


(1.116) 




10 


0.237 (0.260) 


0.451 


(0.396) 


0.421 
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1.119 


(1.027) 




20 


0.182 (0.194) 


0.285 


(0.261) 


0.331 


(0.341) 


0.654 
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50 


0.124 (0.129) 


0.164 
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Table II Coverage of all three methods for n = 5 



Method 


Negative error 


Positive error 


Coverage, % 






Ar'+Vr 




Likelihood 


0.341 


0.621 


67.47 


Bayesian 


0.155 


1.397 


64.31 


Neyman's 


0.302 


0.760 


68.26 



5. Conclusion 

• Neyman's method for confidence intervals pro- 
vides exact coverage, by construction. 

• The intervals from AL = 1/2 agree well with 
the Neyman intervals for large n, but differ for 
small n, as can be seen in Table n In such cases 
they undercover, i.e. the interval is smaller than 
the true one. 

• Bayesian confidence intervals give very different 
results, and can undercover or overcover. 
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